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Abstract 

We study the stability properties of a class of time-varying nonlinear systems. We assume that non-strict input-to-state 
stable (ISS) Lyapunov functions for our systems are given and posit a mild persistency of excitation condition on our given 
Lyapunov functions which guarantee the existence of strict ISS Lyapunov functions for our systems. Next, we provide simple 
direct constructions of explicit strict ISS Lyapunov functions for our systems by applying an integral smoothing method. We 
illustrate our constructions using a tracking problem for a rotating rigid body. 

Key words: Lyapunov functions, input-to-state stabilization, nonautonomous systems. 
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1 Introduction 



The theory of input-to-state stable (ISS) systems 
plays a central role in modern non-linear control 
and controller design (see 



analysis 



Jysu . 

I2nnl IMalisoff & Sontad l2nM ISontagnToOsT 120011 



Sontag k Wand. Il995tl) The ISS property was intro- 
duced by Sontag in l)Sonta'3 . ll989() and an ISS Lyapunov 
ch aracterization was obt ained by Sontag and Wang 
in ijSontag fc Wand IToOSj) . The ISS Lyapunov charac- 
terization provides necessary and sufficient conditions 
for time-invariant systems to be ISS, in terms of the 
existence of so-called strict ISS Lyapunov functions; 
see Section 2 below for the relevant definitions and 
ijEdwards et a/.l.l2000|) for an extension to time-varying 
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systems. Strict Lyapunov functions have been used to 
design stabilizing feedback laws that render asymptot- 
ically controllable systems IS S to actuator erro r s and 
small observa tion noise; see ijMalisoff fc Sontad I200I 
Igontag, '2001) . Such control laws are expressed in terms 
of gradients of Lyapunov functions and therefore re- 
quire explicit strict Lyapunov functions in order to be 
implemented. This has motivated a great deal of re- 
search devoted to constructing explicit strict Lyapunov 
functions. 



One obstacle to these constructions is that the known 
strict Lyapunov functions from the existence theory are 
optimal control value functions, involving a supremum 
of a cost crit erion over infinitely many possible solution 
paths (see (jB acciotti fc Rosier, 2001; Edwards et all 
i2000t ISontag fc Wane. .1995 ; Tecl fc Praly, 200fl)), and 
therefore are not explicit. Although value functions can 
often be expressed as unique solutions of Hamilton- 
Jacobi (HJ) equations subject to appropriate side con- 
ditions, the usual techniques for computing value func- 
tions in terms of HJ equation solutions can be difficult 
to implement. For certain special kinds of systems, strict 
ISS Lyapunov functions can be explicitly constructed by 
ad hoc means. On the other hand, there are numerous 
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important cases where it is relatively straightforward to 
use backstepping or other known methods to construct 
explicit non-strict ISS Lyapunov functions (see our def- 
initions of ISS and non-strict ISS Lyapunov functions 
in Section 2 and Section 4 for an ex plicit example). For 
insta nce, applying the methods of ijJiang fc Niimeiieil 
Il997|) to tracking problems for nonholonomic systems 
in chained form results in non-strict Lyapunov func- 
tions. The constructions in ijMazenc &_Pralv, 200(1 also 
frequently give rise to non-strict Lyapunov functions. 

This motivates the search for techniques for construct- 
ing strict ISS Lyapunov functions for time-varying sys- 
tems, in terms of known non-strict ISS Lyapunov func- 
tions. This search is the focus of this note. For time- 
varyi ng systems with no controls, the paper ijMazend 
l2003 t) constructed strict globally asymptotically stable 
(GAS) Lyapunov functions in terms of given non-strict 
GAS Lyapu nov funct i ons. H ere we further develop the 
approach in ijMazend l2003() . We provide the necessary 
background on ISS systems and Lyapunov functions in 
Section 2. We then introduce a non-strict generalization 
of ISS in which the dissipation rate depends on a non- 
negative time-dependent decay parameter. The param- 
eter can be zero along intervals of positive length. How- 
ever, when the parameter is identically one, our non- 
strict ISS property agrees with the usual ISS condition. 
Under a mild non-degeneracy assumption on this pa- 
rameter, whi ch is of persistenc y of e xcitation type (see 
for instance l|Loria et all. |2002 » and fLoria fc Pantelevl 
,2002) for definitions and discussions of the concept of 
persistency of excitation), we show that our non-strict 
ISS property is equivalent to the existence of a strict ISS 
Lyapunov function and is therefore also equivalent to 
the standard ISS condition. We prove these equivalences 
in Section 3. They are proved by explicitly constructing 
strict ISS Lyapunov functions. In Section 4, we illustrate 
our constructions using a tracking example. Concluding 
remarks in Section 5 end the paper. 

2 Preliminaries 

Let /Coo denote the set of all continuous functions p : 
[0, oo) [0, oo) for which (i) p{0) = and (ii) p is 
increasing and unbounded. Let ICC denote the set of all 
continuous functions /3 : [0, oo) x [0, oo) — > [0, oo) for 
which (1) for each t > 0, (3{-,t) is strictly increasing and 
/3(0,t) = (2) (3{s, •) is non-increasing for each s > 0, 
and (3) /3{s, t) ^ as t ^ +oo for each s > 0. 

We study the stability properties of the fully nonlinear 
nonautonomous system 

x = f{t,x,u), i > 0, x e M", u G (1) 

where we a lways assume / is locally Lipschitz in (t, x, u). 
Following fMazend l2003() , we also assume / is periodic 
in t, which means there exists a constant T > such 



that fit + T, X, u) = f{t, X, u) for alH > 0, a: G R", and 
u G M™. However, most of our arguments remain valid 
if this periodicity assumption is weakened to requiring 
/ to be uniformly locally bounded in t, meaning, 

sup{|/(t,a;,u)| : ix,u) e K,t>0} < +oo (2) 

where | ■ | is the usual Euclidean norm. The control func- 
tions for our system (1) comprise the set of all measur- 
able locally essentially bounded functions a : [0, oo) 
M™; we denote this set by U. We let \a\i denote the es- 
sential supremum of any control a €U restricted to any 
interval / C [0, oo). For each to > 0, Xo G M", and a G U, 
we let / 9 t 1-^ (/)(<; Xo, to, a) denote the unique trajec- 
tory of (1) for the input a satisfying x(to) = Xo and 
defined on its maximal interval / C [t^, oo). This trajec- 
tory will be denoted by (j) when this would not lead to 
confusion. We say that / is forward complete provided 
each such trajectory is defined on all of [to, oo). 

A function V : [0, oo) x R" ^ [0, oo) is said to be 
of class UPPD (written V G UPPD) provided it is uni- 
formly proper and positive definite, which means there 
exist ai, a2, G /Coo such that, for alH > 0, a; G M", 

ai{\x\) <V{t,x) <a2{\x\), \VV{t, x)\ < a^Hxl). (3) 

We say that V has period r in t provided there exists 
a constant r > such that V{t + t,x) = V{t, x) for all 
t > and X G M"; in this case, the bound on VV" in (3) 
is redundant. We assume ai and a2 in (3) are C^, e.g., 
by taking 0:2(5) = a3{r)dr and minorizing ai by a 
function of class /Coo- Given V G UPPD, we set 

dV dV 
V{t, X, u) ~ + "^(^' ^)/(^' ■")■ 

Notice that s 1— > sup{|y(t, x, u)\ : t > 0, \x\ < x(s), l"l < 
s} -I- s is of class /Coo for each x G /Coo (by (2)-(3)). We 
let V denote the set of all continuous functions p : M — > 
[0, 00) that admit constants T,e,p > for which 

//_^ p{s)ds > e and p{t) < p , Vt > 0. (4) 

We write p G V{T,e,p) to indicate that (i) p G "P and 
(ii) T,e,p > are constants such that (4) holds. In par- 
ticular, any continuous periodic function p : M — ^ [0, 00) 
that is not identically zero admits constants r, e,j3 > 
satisfying (4). On the other hand, (4) also allows non- 
periodic p with arbitrarily large null sets, e.g., for fixed 
r > 0, set pr{t) ^ (1 + e~*)max{0,sin^(i)}. The ele- 
ments of V serve as the decay rates for our non-strict 
Lyapunov functions as follows: 

Definition 1 Letp G V. A functionV G UPPD is called 
an ISS(p) Lyapunov function for (1), provided there exist 
X G /Coo and p G /Ceo H such that 

\x\>x{\u\)^V{t,x,u)<-p{t)fi{\x\) Vt>0. (5) 
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AnlSS(p) Lyapunov function for (1) andp{t) — 1 is also 
called a strict ISS Lyapunov function. 



3 Equivalent Characterizations of Non-Strict 
ISS 



Notice that (5) allows V{t,x,u) = for those t where 
p{t) = 0. This corresponds to allowing V to non-strictly 
decrease along the solutions (p of (1). 

Definition 2 Let p G P. We say that (1) is ISS(p), or 
that it is input-to-state stable (ISS) with decay rate p, 
provided there exist (3 G /C£ and 7 £ /Coo such that for 
all to > 0, Xo G K", Uo€U and h>0, 



\(l){to + h;Xo,to,Uo)\ < 13 (^\xo\, J^"'^'' pis)ds^ 



(6) 



+1 {Wo\lt,,t^+h]) ■ 

If (1) is ISS(p) with p = 1, then we say that (1) is ISS. 

Notice that ISS(p) systems are automatically forward 
complete. We also study dissipation-type decay condi- 
tions as follows: 



Definition 3 Letp G V . A functionV G UPPD is called 
a non-strict dissipative Lyapunov function for (1) and 
p, or a DIS(p) Lyapunov function, provided there exist 
O G /Coo O'nd fi G /Coo n such that, for all t > 0,x € 



r,M G 



V{t,x,u) < ~p{t)fi{\x\)+n{\u\) 



(7) 



A DIS(p) Lyapunov function for (1) andp(t) — 1 is also 
called a strict DIS Lyapunov function. 

Remark 4 Defi nition 3 is a nonl i near version of the 
property used in \Loria & PanteleH. \200^) to ensure the 
global uniform exponential stability of time-varying linear 
systems belonging to a specific family of systems. Thus, 
the explicit construction of a strict DIS Lyapunov func- 
tion in terms of a given DIS(p) Ly apunov function we 
present in the next section, extends IjLoria & Panteleu . 
\200^) where only linear systems are studied and no strict 
Lyapunov function is constructed. 

We use the following elementary observations: 

Lemma 5 LetT,e,p > be constants andp G P{T,e,p) 
be given. Then: 

(i) 0< Jt_^ (/^*p(r)dr) ds < ^ for allt>0 and 

(ii) [0, 00) 3 h ^ p{h) = inf I f*^''p{r)dr : t > o| ts 
continuous, non- decreasing, and unbounded. 

We leave the proof of this lemma to the reader as a simple 
exercise. 



We next relate the Lyapunov functions and stability no- 
tions we introduced in the last section. We show that 
ISS(p) is equivalent to the existence of an ISS(p) Lya- 
punov function and the existence of a strict ISS Lya- 
punov function. Our proof explicitly constructs a strict 
ISS Lyapunov function for (1) in terms of a given DIS(p) 
Lyapunov function. Moreover, if p G P{t,s,p) and our 
given DIS(p) Lyapunov function both have period r, 
then the strict ISS Lyapunov function we construct also 
has period r. We next prove: 

Theorem 6 Letp G P and f be as above. The following 
are equivalent: 

(Ci) / admits an ISS(p) Lyapunov function. 
(C2) / admits a strict ISS Lyapunov function. 
(C'3) / admits a DIS(p) Lyapunov function. 
(C4) / admits a strict DIS Lyapunov function. 
(C5) / IS ISS(p). 
(Ce) / IS ISS. 

We prove the following implications: (Ci) (C2) 
(C4) (Ci), (C3) ^ (C4), (C2) ^ (Ce), and (Cg) ^ 
(Ce). We fix r, e,p > such that p G P{T,e,p). 
Step 1: (Ci) (C2). If (Ci) holds, then we can find 
an ISS(p) Lyapunov function V for /, and therefore 
ai,a2 G /Coo n satisfying (3) and x G ^00 and 
IJ, G /Coo n satisfying (5). Set 



0.2(3) 



:{f ,l}(a2(s)-t-M(s) + 5), 



wis) := -^fiia^^is)) 



(8) 



Then a2,a2 ^ ^ ^00 nC^. Since V{t,x) < a2(|a;|) for all 
t > and a; G M", the following holds for all t > 0: 

\x\ > x{\u\) ^ V{t,x,u) < -p{t)^{&^\V{t,x))). (9) 

Note too that w G /Coo H . We later use the fact that 



< w'{s) < 



^'("2 \s)) 



4t] 



< 



-^max{f + (^q) 



2r2p 

for all s > 0. Consider the UPPD function 

VHt,x) = V(t,x) +^{t)w{V{t,x)) 

with - fi, ( /,*p(r) dr ) ds. Then 

V^{t,x,u) = [l + £,{t)w'{V{t,x))]V{t,x,u) 



(11) 
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follows from a simple calculation. When \x\ > x(|m|), 
condition (9) gives v{t,x,u) < and therefore also 

+ \Tp{t)~Jl^p{r)dr\ ^^^{a^\Vit,x))) 



< 



< 



-^M52"\«i(N))) Vi>o. 



Since /i o cij ^ o ai e n /Coo, it follows that IS a 
strict ISS Lyapunov function for (1). 
Step 2: (C2) (^4)- Assume (C2), so / admits a strict 
ISS Lyapunov function V. Let and x satisfy condition 
(5) with p = 1. Then the strict dissipative condition (7) 
with p = 1 follows by choosing any G /Coo satisfying 

n(s)> max \V(t,x,u) + n(\x\)} \/s > 0. 

~ {t>0^x\<x(s),\u\<s} ' / - 

Such an exists by our assumptions (2)- (3). Therefore, 
V is itself a strict DIS Lyapunov function for /. 
Step 3: (C4) ^ (Ci). Assume (C4), so / admits a strict 
DIS Lyapunov function V. Let /z, fi € /Coo satisfy (7) 
with p = I; then if |a;| > xd^l) •= A*^"'"(2f^(|'u|)), then 

V{t,x,u) < -]-fi{\x\), so V{t,x,u) < ~^^fi{\x\) 
2 Zp 

for all t > 0. Therefore, V is also an ISS(p) Lyapunov 
function for /, so (Ci) is satisfied. 

Step 4: (C3) <^ (C4). Since p e V is bounded, we 
easily conclude that (C4) imphes (C3). Conversely, as- 
sume V S UPPD is a DIS(p) Lyapunov function for / 
and ai,a2, fi,rt G /Coo satisfy (3) and the DIS(p) re- 
quirements. Define a2, ui G /Coo H and by (8) and 
(11). As before, when jl = /z o cij \ we have v{t,x,u) < 
-p{t)il{V{t,x)) +n{\u\) for alH > 0,x e R",u e R". 
It follows from Lemma 5(i) and (10) that 



l + atW{V{t,x)) e 



' 4 



yt>0,x e 



(12) 



Since it; = ^/i, we deduce that 



y« < ~p{t)fiivit,x)) + lni\u\) 

+ Tp{t)w{V{t,x)) - (/;_^p(r)dr) u;(l/(t,a;)) 
< -£i(7(ai(|a;|)) -I- j^{\u\). 

Since w o ai G n/Coo, it follows that is the desired 
strict DIS Lyapunov function. 

Step 5: (C9.) ^ (C fi ). Th e imphcation (C2) ^ (Cg) 
follows from ('K halil I200I Theorem 4.19, p.l76). (In 
(,KhaliL .2002,) . the controls are bounded piecewise 



continuous functions a : [0, 00) — > R"*, but the re- 
sult from lIKhalilL l2?ffll can be extended to our gen- 
eral control set U using a standard denseness argu- 
ment (see e. g. Rern a rk C. 1.2 and the proof of The- 
orem 1 in llSontad. 119981)') .) The converse was an- 
nounced in ijEdwards et a^J. 120001 Theore n i 1) and 
can be deduced from ('Bacdotti & Rosier', '2001D 
follows. If / is ISS, then (Sontae & Wane, 1995) pro- 
vides X G ^00 such that the constrained input system 
i = /x(i, a;,d) := f{t,x,dx~^{\x\)), \d\ < 1 is uniformly 
globally asymptotically stable (UGAS); i.e., there exists 
/9 G ICC such that for each to > and Xo S R" and 
each trajectory y of satisfying y{to) — Xq, we have 
\y{to + h)\ < f3{\xo\,h) for all /i > 0. By minorizing x~^, 
we can assume it is . This means the locally Lipschitz 
set-valued dynamics F{t,x) — {f{t,x,u) : x(|u|) < |a;|} 
is UGAS, as is its convexification co(F), namely 
{t, x) I— > cojf ( ^,x)| where co deii o tes th e closed con- 
vex hull (cf. ijBacciotti fc Rosie^ l2001l Proposition 
4.2)). Since co(F) is continuous and compact and con- 
vex va lued, and since we are as suming / is periodic 
in t, ijBacciotti fc Rosieil 1200 ll Theorem 4.5) pro- 
vides a time-periodic V G UPPD such that, for all 
a; G R", t > 0, w G F{t,x), 



dt 



Vit,x) + —V{t,x)w < -V{t,x). 
dx 



Recalling the definition of F and assuming (without loss 
of generality) that V satisfies (3) with ai G /Coo H C^, 

\x\ > xi\u\) fit,x,u) G F{t,x) 
V{t,x,u) < -V{t,x) < -Q!i(|a:|) 

for all t > 0, so y is the desired strict ISS Lyapunov 
function for /. This establishes (Cg) ^ {^2)- 
Step 6: (C5) <^ (Ce). Assuming (Cg), there are P G ICC 
such that for all to > 0, Xo ^ R", Uo G ^, and h >Q, 

\(l){to + h;Xo,to,Uo)\ < (3{\xo\,ph) + j{\uo\[t^^t„+h]) 
< (3{\xo\,J,':^%(s)ds) 

+ 7(|uo|[t„,t„+h]), 

where (j) is the trajectory of / we defined in Section 2. 
Therefore, / is ISS(p) so (Cq) => (C5). Conversely, if / is 
ISS(p), then we can find f3 G ICC such that for all to > 0, 
Xo G R", Uo € U, and h>0, 

\(l){to + h;Xo,to,Uo)\ < (3 (^\xo\, Jt"'^'^ p{s)ds^ 

+liWo\[t,,t^ + h]) 

< (3 {\xo\,p{h)) -f 7(|uo|[t„,t„+h])- 

By Lemma 5(ii) , /3(s,t) P{s,p{t)) G ICC, so (C5) ^ 
(Cg), as desired. This proves Theorem 6. 
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Remark 7 Observe that if the functions V, 02, fi, p are 
of class , where k is a positive integer or 00, then the 
particular function a^, in (8) we have chosen implies that 
the function V^{t, x) is of class . 

Remark 8 Our proof of Theorem 6 shows that if V is a 
strict ISS Lyapunov function for f , thenV is also a strict 
DIS Lyapunov function for f . The preceding implication 
is no longer true if our houndedness requirement (2) on 
f is dropped, as illustrated by the following example from 
fWdw ards ct al., 200C): Take the one- dimensional single 
input system x = f{t,x,u) :— —x + (1 + t)q{u — \x\), 
where q : M. M. is any function for which q(r) = 
for r < and q{r) > otherwise. Then V{x) — x^ 
is a strict ISS Lyapunov function for the system since 
\x\ > \u\ ^ V < —x^ butV does not satisfy the strict DIS 
condition (7) for any choices of n and fl. This does not 
contradict our results because (2) is not satisfied. This 
contrasts with the time-invariant case where strict ISS 
Lyapunov functions are automatically strict DIS Lya- 
punov functions. 



4 Illustration 

We next use our results to construct a strict ISS Lya- 
punov function for a tr acking problem for a rotat- 
ing rigid body fs ee l|C rouch. 1984; Mori n et all Il995t 
iMorin fc Samsom [199^ for the backgrou nd and motiva- 
tion for this problem). Following Lefeber l)Lefebeil . l2000l 
p. 31), we only consider the dynamics of the velocities, 
which, after a change of feedback, are 

Wl=(5i+Ui, 1^2 = ^2+^2, UJ3^LUiLJ2- (13) 

where Si and 62 are the inputs and ui and U2 are the 
disturbances. We consider the reference state trajectory 

UJir{t) ^ Sm{t) , 0J2r{t) ^ UJ3r{t) = (14) 

but our method applies to more general reference tra- 
jectories as well; see Remark 9 below. The substitution 
uJi{t) = oji{t)—uJir{t) transforms (13) into the error equa- 
tions 



OJl — Si -\- Ui — cos(<:) , 

UJ2 ^ S2+U2 , 

UJ3 = {uji -f sm{t))u}2 . 



(15) 



By applying the backstcpping approach as it is applied 
in (Jiang & Niimciier, 1997), or through direct calcula- 
tions, one shows that the derivative of the class UPPD 
function 



with Lj (cji, 0)2, wa)"'' along the trajectories of (15) in 
closed-loop with the control laws 

Si{t,uj) = —uji — UJ2UJ3 + cos{t) 
S2{t,^) = -[l + sm{t)i:}i+sm'^{t)](Jj2 (17) 
— (2 sin(t) + cos(t))iD3 

satisfies 



V = -Cbf - (0)2 + sin(i)a)3)2 - sin^(t)a)| 
-\-ijiUi + ((1)2 + sin(t)a;3)M2 

< - 1(1:^2 + sm{t)Co3)^ - sin2(t)w| 

< ~p{t)il{V{u;)) + n{\u\) 



(18) 



with u — [ui, U2) 



p{t) = sin^(t), /i(s) — s and 



fl{s) = . Therefore F is a DIS(p) Lyapunov function 
for (15) in closed-loop with the control laws (17). Ob- 
serve that, in this case, p G V{7t, 7r/2, 1). Setting t = tt 
and w{s) = ■^fl{s) = it follows that (12) also holds. 
Therefore, Steps 3-4 from our proof of Theorem 6 show 

V^{t,Ci;) = V{t,Cu) + [Jl^ (/>(r)dr) ds] w{V{t,Ci;j) 
= [1 + i - 3^ sin(2i)] V{t,[d) 

is a strict DIS Lyapunov function and also a strict ISS 
Lyapunov function for the system (15) in closed-loop 
with the control laws (17). 



Remark 9 We chose to work with the reference trajec- 
tory (14-) because it leads to the simple error equations 
(15). However, one can easily check that a strict ISS Lya- 
punov function can be constructed for any reference state 
trajectory {uJir{t),L02r(t),u!-ir{t)) such that 



SUPt 

ft 



jl L0ir{s)uj2r{s)ds 



< 00 and 



F(t,a)) = i [w^ + {^2 + sin(t)c:)3)2 + Cb. 



(16) 



/t-.K(s)+^ir(s)]rfs>£, Vi>r 
for some constants r, £ > 0. 

5 Conclusion 

For ISS time- varying systems, we provided explicit strict 
Lyapunov function constructions that can easily be per- 
formed in practice. The knowledge of these Lyapunov 
functions allows us to extend the well-known and useful 
theory of ISS systems to a broad class of time-varying 
nonlinear dynamics. We conjecture that a discrete-time 
version of our main result can be proved. 
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